AD-R182  3B7 


UNCLASSIFIED 


DISTRIBUTION  OF  QUALITV  PROGRAM  HANDBOOK ( U )  RRMV 
SOLDIER  SUPPORT  CENTER-NATIONAL  CAPITAL  REGION 
ALEXANDRIA  VA  JUN  07 

F/O  579 


82  307 


(D 

JUNE  1987 


D1K  FILE  CO B 


DISTRIBUTION  OF  QUALITY 
^■PROGRAM  HANDBOOK 


UNCLASSIFIED  .  i 

ifEuftifV  ^LASSIFtCATION  Of  THIS  PAGE  J 

REPORT  DOCUMENTATION  PAGE 


la.  REPORT  SECURITY  CLASSIFICATION 

Unclassified 

lb.  RESTRICTIVE  MARKINGS  I 

NA  1 

2a.  SECURITY  CLASSIFICATION  AUTHORITY 

NA 

3  DISTRIBUTION  /AVAILABILITY  OF  REPORT 

2b.  DECLASSIFICATION  /  DOWNGRADING  SCHEDULE 

Distribution  Statement  A 

4.  PERFORMING  ORGANIZATION  REPORT  NUMBERS) 

S.  MONITORING  ORGANIZATION  REPORT  NUMBERS)  j 

NA 

NA 

_ 

6a.  NAME  OF  PERFORMING  ORGANIZATION 

JS  Army  Soldier  Support  Center — 
National  Capital  Region 

6b  OFFICE  SYMBOL 
(If  applicable) 

ATNC-NMF-A 

7a.  NAME  OF  MONITORING  ORGANIZATION 

6c  ADDRESS  (City,  State,  and  IIP  Code) 

7b.  ADDRESS  (Oty.  State,  and  VP  Code) 

Alexandria,  Virginia  22332 

-0400 

8a.  NAME  OF  FUNOING  t  SPONSORING 
ORGANIZATION 

8b.  OFFICE  SYMBOL 
(If  applicable) 

9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 

Be  ADORE  SS  (City.  State,  and  VP  Coda) 

10.  SOURCE  OF  FUNDING  NUMBERS 

PROGRAM 
ELEMENT  NO.  ' 

PROJECT 

NO 

TASK 

NO. 

WORK  UNIT 
ACCESSION  NO. 

1 1 .  TITLE  (Include  Security  Classification) 


Distribution  of  Quality  Program  Handbook  (Unclassified) 

12.  PERSONAL  AUTHOR(S)  «•—>—«  ' 


13a.  TYPE  OF  REPORT 

13b.  TIME  COVERED 

14.  OATE  OF  REPORT  (Tear.  Month,  Day) 

IS.  PAGE  COUNT  1 

Information 

FROM  TO 

8706 

_ _ 

16.  SUPPLEMENTARY  NOTATION 


_ « _ 

17. 

COSATI  COOES 

18.  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

FIELD 

GROUP 

SUB-GROUP 

05 

09 

19.  ABSTRACT  (Continue  on  reverse  if  necessary  anti  identify  by  block  number) 


The  Distribution  of  Quality  Program  Handbook  explains  what  the  Distribution  of  Quality  (DQ) 
Program  is,  defines  the  specifications  that  proponent  DQ  submissions  must  meet,  and 
describes  one  possible  method  to  meet  these  specifications. 


20  DISTRIBUTION /AVAILABILITY  OF  ABSTRACT 

QJunclassifieo/unlimiteo  □  same  as  rpt  □  otic  users 

21  ABSTRACT  SECURITY  CLASSIFICATION  | 

Unclassified  1 

22a.  NAME  OF  RESPONSIBLE  INDIVIDUAL 

Leslie  B.  Lord 

22b  TELEPHONE  ( Include  Area  Code) 

202-325-3703 

22c  OFFICE  SYMBOL  1 

ATNC-NMF-A  I 

00  FORM  1 473, 84  MAR  S3  APR  ed.tion  may  be  uied  unt.l  eibausted  SECURITY  CLASSIFICATION  Of  This  PAGE 

All  othar  editions  are  obsolete 


UNCLASSIFIED 


4 '  I 


DISTRIBUTION  OP  QUALITY  <DQ> 


PROGRAM  HANDBOOK 
JUNK  1917 


I 


The  Distribution  of  Quality  Handbook  and  tho  oonoopts  boro  in 
wars  developed  by  tho  Personnel  Progress  and  Analysis  Branch, 
Personnel  Plans  Division,  Nanning  Integration  Directorate,  of  the 
United  States  Amy  Soldier  Support  Center-- Nat ional  Capital 
Region.  Questions  and  eoaaents  concerning  any  concepts  within 
this  Handbook  should  be  addressed  to: 

COWIANDBR 

USA  Soldier  Support  Center— NCR 
Attn:  ATMC-NMF-A 
200  Stovall  Street 
Alexandria,  Virginia  22322-0400 

TBLKPHONS:  CONN  <703>  S2S-S703 

AUTOVON  221-3703  /  ,.„r 


TABLE  OF  CONTENTS 


CHAPTER  1 .  . . .  4 

OVERVIEW  OF  THE  DISTRIBUTION  OF  QUALITY  <DQ>  PROSRAH  .  4 

What  Is  tha  DQ  Prog ran? . . .  4 

Why  th*  DQ  Prog ran?  . . 4 

DQ  and  tha  Skill  Laval  3  (8L3)  Data  Prograa  ...  5 

DQ  and  Project  A .  fi 

Prinary  Organizations  and  thair  Rssponsibi I itias  .  7 

CHAPTER  2  .........................  10 

SPECIFICATIONS  FOR  PROPONENT  DQ  REQUIREHENTS 

SUBHI88I0N8 .  10 

Btap  It  Idantify  tha  Targat  Skill  Laval .  10 

8 tap  2t  Sal act  tha  saasura(s)  of  job  parfornanca  10 

Stap  3t  Validata  tha  naasuraCs)  of  job 

parfornanca  . .  11 

Stap  4t  Sat  tha  nininun  accaptabla  sc or a  ....  11 

Stap  Si  Adninistar  tha  parfornanca  naasuraCs)  and 

collact  tha  data .  11 

Stap  Si  Quantify  tha  ralationship  batwaan  quality 

and  parfornanca .  11 

Stap  7i  Calculata  tha  Skill  Laval  1  accassion 

Distribution  of  Quality  nix  raquirad  11 

Stap  8i  Assass  tha  probabla  inpact  of  projactad 
changas  on  tha  raquirad  SL1  accassion  DQ 

nix .  11 

Stap  9i  Prapara  and  subnit  tha  analysis  raport  12 

CHAPTER  3 .  IS 

DQ  PROCESS  AND  MILESTONES .  15 

APPENDIX  A .  17 

ARMED  FORCES  QUALIFICATION  TEST  CAFQT>  CATEGORY  TABLE  .  17 

APPENDIX  g  .  ........  18 

DETERMINING  CONTENT  VALIDITY*  18 

APPENDIX  C .  21 

DETERMINING  RELIABILITY .  21 

APPENDIX  D .  26 

TESTING  THE  SIGNIFICANCE  OF  r .  26 

APPENDIX  E .  27 

DETERMINING  THE  MINIMUM  ACCEPTABLE  SCORE .  27 

APPENDIX  F .  34 

TESTING  THE  STATISTICAL  SIGNIFICANCE  OF  THE  DIFFERENCE 

BETWEEN  TWO  MEANS .  34 


2 


APPENDIX  6 .  38 

ESTABLISHING  DO  REQUIREMENTS .  38 

APPENDIX  H .  43 

SAMPLE  DQ  ANALYSIS  REPORT .  43 


CHAPTER  1 


OVERVIEW  OP  THE  DISTRIBUTION  OP  QUALITY  <DQ>  PROGRAM 


The  Distribution  of  Qoaiity  (DQ>  Program  is  tho  system 
Proponents  ass  to  Jestify  tho  porooBtogos  of  roeroits  in  APQT 
Categories  I-IIIA,  IIIB,  and  IV  needed  in  thoir  nooossion  M08 
eaoh  yoor.  Tho  prianry  oons ids rat ions  in  this  proooss  aro  tho 
roeroits*  probability  of  achieving  soeeossfol  ontry  level 
train log/ job  porforaanoo  and  onsorlng  an  adoqoato  pool  of  high 
qoaiity  porsonnol  fron  which  to  grow  fotoro  NCO  loadorshtp.  Tho 
working  definition  of  a  high  qoaiity  recruit  is  a  high  school 
dlploaa  gradoato  whoso  Arnod  Poroes  Goal  if  ieation  Tost  (APQT) 
soars  percent llo  is  in  the  top  half  of  tho  national  popelation 
(Categories  I-IIIA) .  By  lav,  the  percentage  of  Category  IV 
roeroits  cannot  eioeed  20  percent  per  year,  and  APQT  Category  V 
persoaael  are  not  eligible  for  aiiitary  service .  A  table  showing 
tho  sis  APQT  categories  and  the  percentile  ranges  of  each  is 
located  In  Appendls  A. 

As  the  proponent  staff  Integrator  for  both  the  Departeent  of 
the  Amy  and  the  Training  and  Dootrine  Command  (TRADOC),  the 
Soldier  Sopport  Center— Hat  tonal  Capital  Region  (88C-MCR)  is 
responsible  for  developing  and  nanaglng  the  Dlstrlbotlon  of 
Qoaiity  Progran.  8SC-NCR*s  doties  1 no lode  aoting  as  the  TRADOC 
eseootlve  agent  and  the  Proponents*  advocate  In  working  with  the 
Of  floe  of  tho  Army  Depoty  Chief  of  Staff  for  Personnel  (0DC8PER) 
and  tho  Roeroiting  Command  (08AREC)  to  establish  the  DQ  targets 
far  each  NOS  in  the  developnect  of  the  Arny*s  anneal  recroltlng 
o lesion. 


V-A 

'  A  The  Dlstrlbotlon  of  Reality  Progran  was  Instltoted  In  19t2 
to  inflooaoo  tho  plaoenoat  of  high  qoaiity  roeroits  into  the 
Aray*s  varioos  aooosslon  NOS.  Mlnlnoa  Aptitode  Area  (AA)  score 
reqoireaents  for  and  tho  aarket  appeals  of  eaoh  MOS  had 
prevloesly  been  tho  driving  factors  of  roerolt  placement. 
Altheogh  AA  scores  predtet  the  ability  of  soldiers  to  oomplete 
entry  level  training  tor  an  NOS,  they  do  not  predict  soldiers* 
abilities  to  noot  teohaloal  skill  and  leadership  roqoirenents 
beyond  entry  level  training.  Under  tho  DQ  Program,  TRADOC 
provides  a  desired  profile  of  re or sits  by  APQT  category  based  on 
traialag  needs  and  career  force  reqelrenents  in  the  out  years  for 


every  teetulOB  NOS.  This  profils  enables  U8AREC  to  do  s  better 
Job  of  distributing  high  quality  recreits. 

Since  1982,  Congress  has  been  closely  esanining  USAREC's 
budget  in  conjunction  with  the  Aray's  recruiting  successes  and 
has  repeatedly  asked  why  the  Aray  needs  to  recruit  so  aany  high 
quality  soldiers.  The  only  way  the  Aray  can  solidly  justify  its 
aggregate  recruit  quality  needs  to  Congress  is  to  develop  such 
Justification  for  every  accession  H08.  These  justifications  aust 
be  based  on  the  relationship  of  successful  job/training 
per for nance  to  APQT  score  category. 

The  Aray  was  enjoying  unprecedented  success  in  recruiting  a 
high  percentage  of  high  quality  recruits  when  the  DQ  Prograa  was 
proposed  and  initially  iapleaented.  In  this  era  of  tightening 
resource  constraints,  it  is  essential  that  the  Aray  effectively 
aanage  the  NOS  distribution  of  its  high  quality  recruits! 
therefore,  the  aission  of  the  DQ  Prograa  is  now  aore  iaportant 
than  ever. 

TRADOC  subaitted  proponent  DQ  requireaents  to  0DC8PER  and 
08AREC  for  FY84-87,  but  their  influence  was  considerably 
diainlshed  by  the  insufficient  justifications  given  for  aost  of 
the  proponents'  stated  needs.  It  is  essential  that  proponents 
use  Job/training  per for nance  aeasures  as  a  basis  for  justifying 
their  soldier  accession  quality  requireaents.  Continued  failure 
of  aost  of  the  proponents  to  significantly  lnprove  their  recruit 
quality  justifications  any  result  in  lower  percentages  of  high 
quality  recruits  in  the  future. 


S9C-NCR  is  TRADOC's  executive  agent  for  the  Skill  Level  3 
<8L3>  Data  Prograa.  The  DQ  and  the  SL3  Data  Prograas  are 
parallel  atteapts  to  achieve  the  sane  purpose.  The  SL3  Data 
Prograa  was  iapleaented  at  the  request  of  the  Vice  Chief  of  Staff 
of  the  Aray  (VCSA)  to  suppleaent  the  DQ  Prograa.  The  DQ  Prograa 
was  designed  to  enable  the  Aray  to  base  its  analyses  of  personnel 
quality  requireaents  on  the  relationship  of  NCO  quality  to 
perforaance.  The  intent  was  for  an  annual  test  prograa  to 
evaluate  NCO  perforaance  and  quality  for  soae  NOS  each  year  until 
the  personnel  quality  needs  for  all  N08  are  certified  and  to  have 
whatever  annual  re-looks  are  needed  in  future  years. 

There  have  been  two  8L3  Data  subaissions  to  0DC8PER,  but  the 
data  of  both  subaissions  have  proved  to  be  of  little  utility  in 
suppleaent ing  DQ  due  to  a  nuaber  of  prograa  iapleaentat ion 
probleas.  Proponents  who  choose  to  follow  the  procedures 
outlined  in  this  handbook  will  be  able  to  aeet  the  requireaents 
of  both  the  DQ  and  the  SL3  Data  Prograas  siaultaneously . 


PQ  and  Project  A 


Project  A  is  th*  Army’s  portion  of  a  Joint  Sarvica  project 
directed  into  existence  by  Congress  end  the  Assistant  Secretary 
of  Defense  (Manpower,  Reserve  Affairs,  and  Logistics)  in  1980  to 
link  enlistment  standards  to  job  performance.  The  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  CARD  is 
responsible  for  accomplishing  this  mission.  The  major  thrusts  of 
this  project  are  to  determine  how  well  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB)  predicts  performance  on  the 
job  and  to  evaluate  other  potential  selection  and  classification 
measures.  The  21  MOS  included  in  this  long  term  research  project 
were  chosen  to  be  maximally  representative  of  all  entry  level 
specialties.  Before  Project  At  it  was  known  that  the  current 
ASVAB  is  a  valid  predictor  of  entry  level  training  success,  but 
there  was  a  need  to  establish  its  validity  for  predicting  actual 
job  performance  and  to  develop  new  tests  for  a  wider  range  of 
attributes  that  contribute  to  performance  Ce.g.,  motivation, 
psychomotor  abilities,  and  spatial  ability).  A  number  of  these 
attributes  has  been  identified,  and  new  tests  of  them  are  being 
validated  for  these  21  MOS.  For  this  effort,  ARI  has  developed  a 
wide  range  of  performance  indicators,  including  hands-on  tests 
(for  9  MOS),  written  tests,  and  ratings  by  peers  and  supervisors. 
Also,  scores  on  the  Skill  Qualification  Tests  (SQTs)  for  more 
than  265,000  soldiers  in  172  MOS  are  being  used  to  validate  the 
ASVAB.  Methods  for  generalizing  the  results  from  the  21  Project 
A  MOS  to  the  domain  of  all  entry  level  specialties  are  being 
developed.  The  product  of  these  efforts  will  be  a  proposal  to 
augment  the  ASVAB.  This  product  will  not  set  minimum  standards 
for  entry  into  training  for  any  MOS,  but  it  should  enable  the 
Army  to  improve  its  process  of  matching  new  soldiers  to  the  MOS 
for  which  they  are  best  qualified. 

If  the  Army  chooses  to  implement  fully  for  all  MOS  such  an 
expanded  ASVAB,  the  DQ  and  the  SL3  Data  Programs  in  their  present 
form  will  probably  become  extinctf  however,  it  is  highly 
improbable  that  such  implementation  could  be  accomplished  prior 
to  the  mid-1990s.  Meanwhile,  the  annual  DQ  mission  must  be 
accomplished  using  the  tools  currently  available  (i.e.,  proponent 
validated  performance  measures  plus  the  AFQT  and  the  appropriate 
AA  scores  from  the  current  ASVAB)  to  effectively  manage  its 
distribution  of  high  quality  recruits  and  answer  Congress’ 
questions  on  its  recruit  accession  quality  needs.  Any  available 
Project  A  data  that  can  help  the  DQ  Program  achieve  these 
objectives  should  be  used. 


Success  of  the  DQ  Program  Is  dependent  upon  the  coordinated 
and  cooperative  efforts  of  many  people  in  various  parts  of  the 
Ar  ay.  The  priaary  organizations  involved  in  this  mission  and 
their  functions  are: 

1.  Proponent  Schools 

>Deteraine  MOS  performance  requirements 

> Justify  DQ  goals  based  on  MOS  performance  requirements 

2.  SSC-HCR 

>Provides  guidance  to  Proponents 

>Provides  technical  assistance  to  Proponents 

>Collects,  consolidates,  and  submits  Proponents*  DQ 
requirements 

>Analyzes  Proponents*  justifications  and  other  factors  to 
provide  alternatives/recommendations  for  trade-off 
analysis  decisions 

Represents  Proponents  and  TRADOC  in  trade-off  analysis 
with  USAREC  and  ODCSPBR 

3.  Headquarters,  TRADOC 

>Provides  guidelines/sets  priorities  for  DQ  mix,  if 
necessary 

>Part icipates  in  trade-off  analysis  with  USAREC,  ODCSPER, 
and  SSC-NCR,  if  necessary 

4.  USAREC 

>Provides  information  to  ODCSPER  on  what  DQ  accession 
goals  are  feasible  based  on  market  and  resource 
projections 

Recruits  the  DQ  mis  as  set  by  ODCSPER  in  the  annual 
recruiting  mission 

5.  ODCSPER 

Reviews  TRADOC* s  DQ  requirements  and  USAREC* s  DQ  proposal 
based  on  economic  feasibility 


>Conducts  trade-off  analysis  between  TRADOC  and  U8AREC 
>Det ermines  USAREC  DO  production  goals  for  annual  Mission 

Fro*  this  list,  it  is  apparent  that  the  Proponents' 
requirements  are  reviewed  and  analyzed  several  times  before  the 
recruiting  mission  is  set.  The  DQ  decision  process  involves 
interaction  among  SSC-NCR/ TRADOC,  ODCSPER,  and  (JSAREC.  This 
process  and  the  primary  issues  involved  are  shown  in  Figure  1. 


CISION  PROCESS 


O 


CHAPTER  2 


SPECIFICATIONS  FOR  PROPONENT  DQ  REQUIREMENTS  SUBMISSIONS 


The  process  of  determining  Proponent  secession  quality 
requirements  includes  both  objective  and  subjective  factors; 
i.e.,  objective  tools  are  used  to  assist  in  making  subjective  but 
credible  assessments.  In  most  schools,  this  process  will 
probably  be  an  integration  of  efforts  by  the  Proponent  Office, 
Directorate  of  Combat  Development  (DCD),  the  Directorate  of 
Training  and  Doctrine  (DOTD),  the  Directorate  of  Evaluation  and 
Standardizat ion  (DOES),  the  training  departments,  and  possibly 
some  other  offices. 

In  this  chapter  are  the  general  procedures  that  Proponents 
must  follow  to  justify  their  DQ  requirements  for  each  of  their 
accession  MOS  and  the  minimum  standards  that  each  DQ  submission 
must  meet  at  every  step  to  be  considered  credible.  For  some  of 
these  steps,  there  may  be  a  number  of  different  ways  to 
accomplish  them  and  still  meet  the  requirements  of  these 
specifications.  In  such  cases,  appropriate  appendices  have  been 
placed  in  this  handbook  to  provide  the  implementation  details  of 
a  suggested  methodology  for  those  Proponents  who  choose  to  use 
it.  Proponents  who  choose  to  use  some  other  methodology  to  meet 
these  requirements  must  obtain  prior  approval  of  their 
methodologies  from  SSC-NCR.  In  addition  to  following  the 
procedures  outlined  in  this  chapter.  Proponents  should  also 
include  in  their  assessments  such  factors  as  the  impact  of  new 
equipment  scheduled  for  deployment  and  projected  changes  in 
doctrine,  training,  and  organization  within  the  next  five  years. 

Step  1:  Identify  the  Target  Skill  Level.  Target  Skill  Level  is 
defined  as  that  level  which  is  most  critical  to  mission  success 
or  failure  in  an  MOS.  Soldiers  at  this  skill  level  have  full 
technical  proficiency  to  do  the  work  and  have  earned  the 
appropriate  rank  to  direct/lead  subordinates  in  daily  Job 
performance.  They  can  also  provide  technical  advice  to  the 
NCOs/officers  above  them.  Traditional  thinking  is  that  Skill 
Level  3  meets  this  definition  in  most  MOS;  however,  such  may  not 
be  the  case  in  many  MOS.  Proponents  must  make  and  justify  this 
determination,  and  justifications  must  be  especially  strong  if 
the  Target  Skill  Level  is  other  than  SL3. 

Step  2t _ Select  the  measure(s)  of  Aob  performance.  The 

performance  measures  must  test  enough  critical  tasks  to  be 
representative  of  the  entire  job  of  soldiers  at  the  Target  Skill 
Level  of  the  MOS.  Usually,  proxies  for  measures  of  job 
performance  are  used.  These  proxies  measure  individual  scores  on 
Job  proficiency  (hands-on  tests)  and/or  job  knowledge  (written 
tests).  Usable  performance  measures  probably  already  exist  in 


Many,  if  not  Most,  NOS.  Since  the  purpose  here  is  to  Measure 
performance  in  a  specific  NOS,  tasks  froM  the  Co mm on  Task  Testing 
(CTT)  Manual  would  not  usually  be  included  in  these  Measures. 

Step  3t  Validate  the  measure(s)  of  Job  performance.  The  two 
issues  of  priaary  concern  here  are  what  a  test  Measures 
(validity)  and  the  quality  of  the  Measure  (rel  iabi  1  i  ty> . 
Validity  is  concerned  with  whether  or  not  the  per  for Mane e  Measure 
is  repr esent at i ve  of  the  job  and  is  usually  a  rational, 
Judgaental  process  (see  Appendix  B>.  Reliability  refers 
specifically  to  the  consistency  of  the  perforMance  Measure.  The 
Most  widely  used  approach  is  the  Kuder-Richardson  Method,  which 
is  a  particularly  appropriate  Measure  of  test  consistency  (see 
Appendices  C  and  D) . 

Step  4:  Set  the  Minimum  acceptable  score  on  the  measure(s)  of 
job  performance.  This  score  should  be  the  minimum  level  of 
performance  for  successful  Job  accomplishment.  If  possible,  it 
should  be  tied  to  the  minimuM  level  necessary  for  mission 
success.  Reasons  for  selecting  this  Minimum  acceptable 
performance  standard  must  also  be  included  in  the  submission  (see 
Appendix  E). 


Step  5:  Administer  the  performance  measure (s?  and  collect  the 

data.  A  sufficient  number  of  soldiers  must  be  tested  to  permit 
statistically  valid  findings,  and  the  soldiers  selected  for 
testing  must  be  representative  of  the  NOS  population  at  the 
Target  Skill  Level.  If  appropriate,  information  on  factors  which 
may  have  affected  performance  (e.g.,  weather)  should  also  be 
col lected. 

S**P  6s _ Quantify  _the_  relationship  between  quality  and 

per formance.  The  mathematical  relationship  between  the  ASVAB 
scores  and  the  performance  of  soldiers  at  the  Target  Skill  Level 
must  be  determined.  A  step  by  step  explanation  of  how  to  test 
the  mathematical  significance  between  ASVAB  data  and  performance 
scores  is  located  in  Appendix  F. 

Step  7:  Calculate  the  Skill  Level  1  accession  Distribution  of 

Quality  mix  required  to  meet  the  quality  requirements  at  the 
Target  Skill  Level.  This  calculation  process  is  often  called 
back  aging.  A  methodology  for  back  aging  DQ  data  is  explained  in 
Appendix  G. 

8* _ Assess  the  probable^  impact  of  pro  jected  changes  on 

required  SL1  accession  DQ  mix.  Accomplishing  this  step  merely 
requires  an  estimate  of  how  much  the  quality  mix  derived  from 
following  Steps  1-7  should  be  augmented  or  diminished  due  to 
projected  changes  in  equipment,  doctrine,  training,  and 
organization  during  the  next  five  years.  Although  this  process 
is  subjective,  cogent  logic  must  be  given  to  substantiate  this 
assessment . 


An  cxMpl*  analysis 


HPS  racruit  accession  quality  raouiranant. 
raport  is  locatad  in  Appandix  H.  All  DQ  analysis  raports  Must 
contain  tha  following  information  in  this  formats 


a.  Summary 

Cl)  A  statamant  of  tha  Proponant’s  position  on  what  tha 
raquirad  racruit  accassion  quality  mix  is  for  tha  MOS 

C2)  A  concisa  anumaration  of  tha  raasons  for  this 
position 

b.  Targat  Skill  Laval 

Cl)  Idanti fi cat ion  of  tha  Targat  Skill  Laval  anal yz ad 

C2)  Discussion  of  tha  critaria  usad  in  salacting  tha 
Targat  Skill  Laval  Ci.a.,  raasons  for  salaction) 

c.  Par  for mane a  maasura(s) 

Cl)  Narrativa  dascription  of  tha  parformanca  maasuraCs) 

C2)  Datailad  discussion  of  tha  validity  and  tha 
raliability  of  tha  parformanca  maasuraCs) 

C3)  Datailad  Justification  of  tha  minimum  accaptabla 
parformanca  scora 

d.  Rasaarch  dasign  and  implamantation 

Cl)  Explanation  of  tha  tast  administration  and  data 
coll act ion  procaduras  usad 

C2)  Discussion  of  tha  statistical  analysis  and  major 
findings 

a.  Conclusion  and  racommandations 

Cl)  Tha  raquirad  racruit  accassion  quality  mix  darivad 
from  following  Staps  1-7 

C2)  An  assassmant  of  tha  probabla  impact  on  soldiar 
quality  raquiramants  of  projactad  changas  in 
aquipmant,  doctrina,  training,  and  organization 
during  tha  naxt  fiva  yaars. 

C3)  An  astimata  of  how  much  tha  raquirad  racruit 

accassion  quality  nix  darivad  from  following  Staps 
1-7  should  be  augmantad  or  diminishad  basad  on  thasa 
projactad  changas. 

Figura  2  is  a  modal  dapicting  tha  procaduras  dascribad  abova 
that  Proponants  must  usa  to  Justify  thair  accassion  quality 
raquiramants.  Tha  first  aight  staps  CStap  9  baing  maraly  raport 
praparation  and  submission)  hava  baan  dividad  into  thraa 
catagoriasi  ampirical  procaduras  CStaps  1-8),  algorithmic 
procaduras  CStap  7),  and  astination  procaduras  CStap  8). 
Proponant  af forts  and  axpartisa  ara  assantial  to  accomplishing 
tha  ampirical  procaduras.  It  is  in  this  catagory  that  Army 
accassion  quality  Justifications  hava  usually  fallan  short.  If 
tha  ampirical  procaduras  ara  not  inplanantad  corractly,  tha 
rasults  of  tha  algorithmic  and  tha  astination  procaduras  can  ba 
naithar  valid  nor  cradibla.  On  tha  othar  hand,  thara  ara  a 
nunbar  of  dafansibla  ways  to  do  tha  algorithmic  procaduras  aftar 
tha  ampirical  procaduras  hava  baan  dona.  Dua  to  tha  work  of  tha 


school  combat  developers,  Proponents  probably  are  in  the  bast 
position  to  sake  tha  subjective  assessments  needed  in  the 
estimation  procedures.  In  other  wordst  the  Proponents'  highest 
DQ  Program  priority  should  be  that  of  isp lamenting  the  empirical 
procedures  correctly. 


PROPONENT  QUALITY  JUSTIFICATION  MODEL 


IMPACT  OF  PROJECTED  CHANGES  ON 
REQUIRED  ACCESSION  QUALITY  MIX 


Collecting  soldier  quality  end  per foruance  dote  in 
accordance  with  the  specifications  in  this  Handbook  is  a 
continuous  process.  Proponents  should  Include  in  this  process 
the  ability  to  extract  the  data  currently  on  hand  to  accomplish 
•taps  i-i  of  Chapter  2  whenever  a  need  arises.  It  is  conceivable 
that  unprogra— d  data  requests  could  cause  a  need  for  such 
information  on  any  NOS  at  any  time.  Steps  1-4  should  be  reviewed 
and  updated  whenever  changes  in  organisat ion,  personnel 
management  policies,  doctrine,  training,  equipment,  etc.,  cause  a 
major  revision  in  an  NOS.  Implementation  of  Steps  1-3  should 
begin  as  soon  as  feasible  after  a  new  NOS  is  created. 

U8AREC  usually  works  on  two  recruiting  missions 
simultaneously!  one  for  the  current  fiscal  year  and  the  other 
one  for  the  next  fiscal  year  under  the  Delayed  Entry  Program 
<DEP>.  UBAREC  prefers  to  recruit  about  half  of  next  fiscal 
year*s  mission  during  the  current  fiscal  year,  if  feasible.  To 
have  the  maximum  amount  of  influence  on  next  year's  mission  (the 
second  recruiting  mission),  TPADOC  must  present  the  fully 
justified  Proponent  recruit  accession  quality  requirements  to 
00C8FCR  and  negotiate  the  final  DO  before  the  current  fiscal  year 
begins.  To  meet  this  objective,  it  is  essential  that  the 
following  milestones  be  met i 

>Nay — Proponent  DO  requirements  for  the  second  recruiting 
mission  submitted  to  80C-MCR 

>Jul y— TItADOC  consolidated  DO  requirements  for  the  second 
recruiting  mission  submitted  to  QOCJPCR 

September — OOCSPER,  UP  APEC,  and  TRAOOC  agree  on  the  most 
feasible  DO  for  the  second  recruiting  mission 

Xktober — UBAREC  starts  recruiting  the  second  half  of  the 

current  fiscal  year  mission  and  the  first  half  of 
the  next  fiscal  year  mission  under  the  DEP 

To  clarify  the  milestone  explanation  above,  the  DO  for  a 
specific  fiscal  year  (FY11)  is  used  below  as  an  examples 

>Nay  Iff  Pi  oponwnt  DO  requirements  for  FY91  should  be 
submitted  to  OBC-NCR 

>Jul y  1909 — TRADOC  consolidated  DO  requirements  for  FV91 
should  be  submitted  to  00CPC1 


Xtpt««b*r  1 989 — ODCVER,  U6AREC,  and  TKAOOC  should  agraa  on 

tha  Most  foasibla  DO  for  FY91 

>Octobar  1969 — UBAWEC  starts  rac rutting  tha  sacond  half  of 
tha  FY90  Mission  and  tha  first  half  of  tha 
FY91  Mission  undar  tha  DEP  (Notai  Agraanant 
on  tha  nost  faasibla  DO  for  FY90  should  hava 
baan  raachad  in  Bsptaabar  1966) 


APPENDIX  A 

I  QUALIFICATION  TEST  CAFQT)  CATSSSORV  TABLE 


ATQT 

Cattgory 

P*rc«ntil* 

kOTM 

I 

S3- IOO 

II 

49-92 

IIIA 

90-44 

1 1  IB 

31-49 

IV 

10-30 

V 

t-9 

IX  B 


DETENHININE  CONTENT  VALIDITY 


Evaluating  the  validity  of  any  parforaanca  aaaaura  is  a  quasi  ion 
of  tha  representativeness  and  adaquacy  of  the  cr  it  aria.  Contant 
validity  is  concarnad  with  whether  or  not  tha  parforaanca  oaasura 
contains  a  fair  saapla  of  tha  critical  tasks.  Einca  tha 
procadura  involvas  asking  infarancas  froa  a  saapla  to  a 
population,  an  aval uat ion  of  validity  is  aada  in  taras  of  tha 
adaquacy  of  tha  parforaanca  aaasura.  Operationally,  contant 
validity  is  tha  aitant  to  which  ovarlap  exists  between 
parforaanca  on  the  aaasura  and  ability  to  function  in  the  defined 


Eton  li  Establish  a  contant  evaluation  panel. 

Tha  contant  evaluation  panel  is  c  nap  need  of  job  inc  unbent  s, 
supervisors,  trainers,  and  coaaand  staff. 

Etas  2«  Identify  criU^l  tmmkm  to  he  evaluated. 

The  contant  evaluation  panel  will  initially  review  all  existing 
aaterials  relating  to  tha  NOB  and  define  tha  critical  tasks  as 
wall  as  tha  associated  knowledge,  skills,  and  abilities.  Tha 
resultant  list  is  distributed  to  each  panel  aeober  for  review. 

tea  J« _ Evaluate  test  itaaa  fisiastt  tins. 

The  resultant  list  of  critical  tasks  is  presented  to  each  panel 
aeober  with  a  sat  of  test  questions  and  independently  indicates 
whether  tha  knowledge,  skill,  or  ability  aeasured  by  each  test 
question  ist 

-Essential | 

-Useful  but  net  essential |  or 

to  tha  parforaanca  of  tha  critical  task. 

An  itaa  is  rated  essential  if  tha  soldier  oust  possess  this 
knowledge,  skill,  or  ability  to  successfully  per  fora  tha  task. 

On  tha  other  hand,  an  itaa  is  rated  useful  if  possessing  this 
knowledge,  skill,  or  ability  would  enhance  tha  soldier's 
per  for nance.  Additionally,  iteas  rated  as  useful  noraally  can  be 
learned  on  the  job.  Iteas  rated  not  necessary  to  the  per  for nance 


IB 


of  tha  task  is  sal  f-axplanatory.  Tha  for  sat  shown  balow  say  ba 
usaful  in  avaluating  tha  it ass  for  ralavancy. 


Evaluation  Shaat 


(Nana  of  Panal  Naabar)  (Data) 


(Par  for sane a  Haasura  Titla) 

Plaasa  indicata  by  a  chack  aark  (  >  your  rating  in  tha 

appropriata  box. 

It  a*  Nuabar  (Essantial)  (lisaful)  (Not  nac  assary) 

•1 

•2 

•3 


It IB  4l  poaauta  tha  eontant  validity  ratio. 

Rasponsas  froa  all  panalists  ara  pool ad  and  tha  nuabar  indicating 
"assantial"  for  aach  itaa  is  datarainad.  Whan  all  panalists 
indicata  that  an  itaa  is  assantial  or  not  assantial ,  ana  can  hava 
confidanca  that  tha  itaa  is  or  is  not  truly  assantial.  It  is 
whan  thara  is  no  consansus  that  problass  arisa.  Tharafora,  tha 
following  an  swap  t  ion  is  aadai  any  itaa  which  is  parcaivad  to  ba 
assantial  by  aora  than  half  (bayond  SOX)  of  tha  panalists  has 
soaa  dagraa  of  validity  and  will  ba  count  ad  as  assantial.  A 
eontant  validity  ratio  is  than  cosputad  for  aach  tast  itas.  Tha 
for aula  for  coaputing  tha  CVR  1st 

-  na-(N/2) 


(N/2) 

wh ara  "na"  is  tha  nuabar  of  panalists  indicating  assantial  and  N 
is  tha  total  nuabar  of  panalists. 

Ttli  tarh  l*—  for  statistical  sianificanca. 

Tast  i taas  ara  aliainatad  if  tha  CVR  fails  to  aaat  statistical 
sign! ficanca.  For  axaapl av  whan  tha  eontant  aval uat ion  panal  is 
coaposad  of  IS  aaabars,  a  ainiaua  DR  of  .49  is  raquirad  to 


satisfy  tha  .05  laval  of  sign! f icanca.  Only  thosa  itaas  with  CVR 
valuas  aaating/axcaading  this  ainiMNi  ara  ratainad  in  tha  tast. 

Mini sun  valuas  of  CVR 
(Ona-tailad  tast,  p  ■  .09) 

Total  nuabar  Hiniaua  valua 

of  panalists 


9 

.99 

6 

.99 

7 

.99 

8 

.79 

9 

.78 

10 

.82 

11 

.99 

12 

.96 

13 

.94 

14 

.91 

19 

.49 

20 

.42 

29 

.37 

30 

.33 

39 

.31 

40 

.29 

(This  tabla  is  takan  from  "Parsonnal  Psychology”  (Vol  28,  963- 
979).  C.  H.  Lawsha.) 


Btao  6»  Coaputa  tha  contant  validity  indax. 

Tha  CV1  is  coaputad  for  tha  whola  tast.  Tha  CVI  is  tha  naan  of 
tha  CVR  valuas  of  tha  ratainad  itaas  aaating  tha  ainiaua  CVR 
tab lad  valua.  Tha  foraula  for  coaputing  tha  CVI  isi 

■  iwum  CVR) 

N 


APPENDIX  C 


DETERMINING  RELIABILITY 
Background  and  Prev iew 

Reliability  MtiMtM  indicate  the  degree  of  consistency  of  the 
perfornance  Measure.  The  technique  used  in  this  Methodology, 
the  Kuder-Richardson  reliability  coefficientf  involves  an 
analysis  of  iten  variance  which  indicates  the  degree  to  which  the 
various  test  itens  on  a  test  are  intercorrelated. 

The  for su la  for  conputing  the  reliability  coefficient  isi 

ax- (sum  pg)1 

.  “*  J 

where  n  is  the  nuMber  of  iteMS  on  the  test,  and  mJ*  i%  the 
variance  of  the  total  scores  on  the  test.  The  final  tern  (sum 
pq)  is  found  by  conputing  the  proportion  of  the  group  who  pass 
(p)  and  do  not  pass  (q)  each  iten,  where  q«l-p.  The  product  of  p 
and  q  is  then  conputed  for  each  iten,  and  these  products  are 
added  for  all  itens  to  yield  sun  pq. 

The  fornula  for  conputing  the  variance  isi 

sx*«  sun (x*)- (sun  xf* 

_ n 

n 


SttP  ll _ Conoute  an  index  of  internal  consistency. 


Suppose  that  a  ten-iten  test  was  adninistered  to  ten  people. 
Each  iten  was  scored  either  1  or  Of  i  for  a  correct  response,  O 
for  an  incorrect  response.  The  results  werei 


1 

People 
A  1 

B  1 

C  1 

D  1 

E  1 

F  1 

G  1 

H  1 

I  1 

J  1 


2  3  4 


0 


Iten 

S  6  7 

111 
111 
111 
111 
10  1 
1  1  0 

10  0 
1  0  0 

0  10 

0  1  0 


8  9  10 

111 
110 
0  10 
10  0 
0  0  1 

10  0 
10  0 
O  1  O 

0  0  0 

0  0  0 


10 

9 

8 

8 

7 

7 

6 

6 

5 

4 


10  10  10 


8 


70 


21 


Th*  proportion  passing  each  item  (p>  is  the  nuibar  of  paopla 
passing  tha  item  (n)  divided  by  tha  total  nunber  in  tha  sanpla 


(n»10).  The  proportion 
data  are  shown  balowt 

failing 

tha 

item 

(q)  equals 

1“P. 

These 

item 

l 

2 

3 

4 

5 

6 

7 

8 

9 

10 

10 

10 

10 

9 

8 

7 

5 

5 

4 

2 

P 

1.0 

1.0 

1.0 

0.9 

0.8 

0.7 

0.5 

0.5 

0.4 

0.2 

q 

0.0 

0.0 

0.0 

0.1 

0.2 

0.3 

0.5 

0.5 

0.6 

0.8 

pq 

.oo 

.00 

.00 

.09 

.16 

.21 

.25 

.25 

.24 

.16 

The  figura  naadad  for  tha  formula  (sum  pq)  is  tha  product  of  pq 
sunned  over  all  ten  it east 


sun  pq«.09  +  .16-*-  .21  +  .25  +  .25  +  .24  +  .16  *  1.36 
Step  2: _ Calculate  s^ 

To  calculate  sx,  write  down  in  colunn  form  each  case  and  the 
corresponding  score. 


1  2 


Cases 

X*  X 

A 

io 

B 

9 

C 

8 

D 

8 

E 

7 

F 

7 

G 

6 

H 

6 

I 

5 

J 

4 

n* 

sun  (x*>  (sun  x> 

(sun  xt 


SUa  3i  Oil  In  ih±  lafel*. 

a.  Fill  in  colunn  1  by  squaring  the  x  score  in  colunn  2.  At  the 
botton  of  column  1,  add  up  all  the  values  (this  is  sun  (x>  from 
tha  formula). 

b.  Complete  column  2  by  adding  up  all  the  x  scores.  This  is 
(sum  x)  from  the  fornula.  Underneath  write  down  (sum  x 

22 


c.  A  completed  table  is  shown  below. 


1  2 


Casas 

X*> 

X 

A 

100 

10 

B 

81 

9 

C 

64 

8 

D 

64 

8 

E 

49 

7 

F 

49 

7 

G 

36 

6 

H 

36 

6 

I 

25 

5 

J 

16 

4 

520  70 


4900 


Compute  sx? 


=  sum  <  x  A  )  —  C  sum  xJf* 


_ n 

n 

-  520-  4900 

10 

10 

*  (520-490) 

10 


-  3.00 


.6074 
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Interpret  the  statistic. 

The  table  below  provides  the  range  of  possible  correlations  and 
their  usual  interpretations. 


0 


+1.00 — 


,80 — 


,60 — 


,40 — 


.20 — 


OO — 


-.20— 


-.40 — 


-.60 — 


— Perfect  positive  correlation 
_ Very  strong  positive  correlation 

_ Strong  positive  correlation 

_ Moderate  positive  correlation 

Weak  correlation 


— Probably  no  correlation  (Just  chance) 


_ Weak  negative  correlation 


Weak  Moderate  positive  correlation 


8trong  negative  correlation 


-.80 — 


-1.00 — 


_ Very  strong  negative  correlation 


— Perfect  negative  correlation 


APPENDIX  D 


TESTING  THE  SIGNIFICANCE  OF  r 

This  section  discusses  how  such  confidence  to  place  in  a 
particular  correlation.  The  recommended  approach  is  to  establish 
confidence  limits  around  the  coefficient.  These  limits  indicate 
the  range  of  probable  correlations  on  subsequent  runs  of  the 
performance  test. 

The  significance  of  an  obtained  r  may  be  tested  against  the 
hypothesis  that  the  population  r  is  in  fact  zero.  If  the 
computed  r  is  large  enough  to  invalidate  or  cast  serious  doubt 
upon  the  null  hypothesisy  accept  r  as  indicating  the  presence  of 
at  least  some  degree  of  correlation. 

To  make  the  testy  enter  the  table  below  with  (N-2)  degrees  of 
freedom  and  compare  the  obtained  r  with  the  tabulated  entries. 

For  example y  when  N=  1 0 ,  an  r  must  be  .632  and  .765  to  be 
significant  at  the  .05  and  .01  levels  of  signi  ficance, 
respectively.  This  means  that  only  5  times  in  100  trials  would 
an  r  as  large  as  -*-.632  arise  from  fluctuations  of  sampling  alone 
if  the  population  r  were  actually  .00  and  only  once  in  100  trials 
would  an  r  as  large  as  +.765  appear  if  the  population  r  were  . 00. 
It  is  clear  then  that  the  obtained  r  of  .6074y  since  it  is 
smaller  than  the  tabled  values*  is  not  significant  at  the  .05  or 
.01  levels  of  signi f icance. 


Correlation 

coefficients 

at  the 

.05/. 01 

levels  of 

signi ficance 

Degrees  of 

Degrees  of 

Degrees  of 

F  reedom 

Freedom 

Freedom 

(N-2) 

.05 

.01 

(N-2)  .05 

.01 

(N-2) 

.05 

.01 

1 

.997 

1.000 

16 

.468 

.590 

35 

.325 

.418 

2 

.950 

.990 

17 

.456 

.575 

40 

.304 

.393 

3 

.878 

.959 

18 

.444 

.561 

45 

.288 

.372 

4 

.811 

.917 

19 

.433 

.549 

50 

.273 

.354 

5 

.754 

.874 

20 

.423 

.537 

60 

.250 

.325 

6 

.707 

.834 

21 

.413 

.526 

70 

.232 

.302 

7 

.666 

.798 

22 

.404 

.515 

80 

.217 

.283 

8 

.632 

.765 

23 

.396 

.505 

90 

.205 

.267 

9 

.602 

.735 

24 

.388 

.496 

100 

.195 

.254 

io 

.576 

.708 

25 

.381 

.487 

125 

.174 

.228 

11 

.553 

.684 

26 

.374 

.478 

150 

.159 

.208 

12 

.532 

.661 

27 

.367 

.470 

200 

.138 

.181 

13 

.514 

.641 

28 

.361 

.463 

300 

.113 

.  148 

14 

.497 

.623 

29 

.355 

.456 

400 

.098 

.128 

15 

.482 

.606 

30 

.349 

.449 

500 

.088 

.081 

(This 

table 

is  t 

aken 

from  Garrett* 

X 

• 

m 

• 

S 

Statistics  i 

Psychology  and  Education*”  (6th  ed.fNew  York:  David  HcKay*  1966). 
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DETERMINING  THE  MINIMUM  ACCEPTABLE  SCORE 


BisJsflEflNaiLjad  PrtYi.tv 

When  a  continuous  test  is  used  to  distinguish  ssnng  wMbtrs  of  a 
criterion  group,  soat  tast  score  aust  bt  chossn  as  the  cutting 
point.  Salacting  a  cutting  point  is  oftan  difficult  and  is 
typically  dona  arbitrarily  basad  on  soaa  standard  that  is  saan  as 
raasonabla.  Ideally,  tha  cut  scora  should  ba  flaxibla,  not 
absolute,  and  should  considar  tha  tast  scora  distributions  of  tha 
critarion  sample. 

By  astablishing  ar>-f  quantifying  tha  ralationship  and  dapandancias 
batwaan  variables,  a  cut-off  scora  basad  on  various  levels  of 
A8VAB  performance  can  ba  estimated.  One  way  of  estimating  tha 
cut  scora  is  to  fit  a  straight  lina  to  tha  observations. 

Tha  ganaral  form  for  tha  aquation  of  a  straight  lina  ist 

y«=  a+bx 

where  "y"  is  defined  as  tha  variable  whose  value  needs  to  ba 
determined  and  "x"  represents  tha  various  levels  of  ASVAB 
par  for mane a. 

b*  ru<sy/S>  b  represents  the  slope  of  the  line. 

a«  (sum  y)-b<sum  x)  a  represents  the  y-intarcapt  (a  constant 
n  n  value. 


<x4 )-<sum 

_ _ n 

n 


(y4)-(sum 

_ n 

n 


x* 


standard  deviation  of  the  quality  data 
(AFQT  or  AA  Score). 

std  dev  of  the  performance  measure. 


r*  _ CnCsum  xv 3 )-C (sum  x)  (sum  y)3 _  correlation 

^/Cn* sum (x*)- (sum  x)4  3Cn- sum(y*)-(sum  y)*  3 


ru«  r(S/sx) 


-r*)+Cr4 (S4/sx4>  3 


corrected  correlation  coefficient 
for  range  restriction  (in  the 
predictor  variable —  AA  scores) 


where  8  is  the  standard  deviation  of  the  population  and  sx  is 
the  standard  deviation  of  the  sample.  (In  this  methodology  S  is 
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in  coin 
Tills  is 


o.  Fill  is  coluon  S  toy  sfuorlny  IKt  yvoliiM 
ttos  boltoo  of  colusn  Sf  «M  op  all  tow  voluos. 


(A  c— plstsO  tatolo  is  shown  os  tow  followinf  pf»). 


1 

2 

3 

4 

3 

Cmmnm 

4* 

a 

»y 

y 

y4 

1 

10404 

102 

0000 

79 

3241 

2 

13403 

113 

9030 

03 

7223 

3 

9409 

97 

7007 

01 

3031 

4 

11233 

103 

0934 

94 

0333 

3 

9213 

93 

0044 

09 

7921 

A 

10000 

100 

0300 

03 

7393 

7 

11233 

103 

9222 

07 

7039 

• 

7003 

04 

3430 

77 

9929 

9 

13309 

117 

11113 

93 

9023 

to 

14400 

120 

11040 

92 

0434 

11 

9100 

90 

0100 

90 

9100 

12 

11233 

103 

9113 

03 

7393 

13 

12344 

112 

9400 

04 

7033 

14 

12944 

112 

9332 

03 

7393 

13 

14131 

119 

10710 

90 

3100 

li 

12739 

113 

9133 

01 

3931 

n-ll 

101433 

1393 

143047 

1302 

119773 

22073413 

1909924 

.  _ _ 

A  13<101433>-2073413H  13<1 197731-1909924  J 


, _ 2349052-2243972  _ _ 

/< 2903293-20734 13)  (1913413-1909924) 
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ru- 


r (l/tx) 

i-r*)^Ir*  C3*/ok*>  ] 


^ _ +42i2Q/ 12*2*7)  . _ _ 

/tl-C.43**»  C.43#CC30J*/ CIO.  2471^1 

/( 1-.  1M9K[(.  1M9)  C 400/100)  1 

.8393 

/.•I31O.7044 


t—  fa  DtWiAw  tho  olnnlflconco  of  tho  corrtcfd  r. 

N«th*Mtlcallyt  o  ooro  dofonoiblo  oothod  of  tooting  tho 
■ignificonco  of  on  r,  oopoc lolly  vhon  tho  coofficiont  i«  vory 
high  or  vory  low,  i •  to  convort  r  into  o  z-function  ond  find  tho 
otondord  orror  of  z.  Tho  z-function  has  tho  advontogo  ovor  r  in 
that  lt»  otondord  orror  dwpwndo  only  upon  tho  oizo  of  tho  oooplo 
CM)  ond  io  indopondont  of  tho  oizo  of  r. 

30 


i 

> 


! 

i 

i 

t 

» 

i 


Tht  for muI a  for  tha  standard  arror  of  s  1st 


^  /C^3" 


Ouppoaa  that  r»  .MOV  and  Ih  14.  According  to  tha  tahla  ah  own 
balowt  an  r  of  .MOV  c or r ■■panda  to  a  i  of  .03. 


Convarsion  of  ar 

i  r  into  a 

r or r ■aporo 

ding  i-coa 

f ficiant 

r 

z 

r 

a 

r 

z 

.29 

.24 

.40 

.49 

.90 

1.47 

.24 

.27 

.41 

.71 

.905 

1.90 

.27 

.20 

.42 

.73 

.910 

1.93 

.24 

.2V 

.43 

.74 

.915 

1.94 

.29 

.30 

.44 

.74 

.920 

1.99 

.20 

.31 

.45 

.70 

.925 

1.42 

.31 

.32 

.44 

.79 

.930 

1.44 

.32 

.33 

.47 

.01 

.935 

1.70 

.33 

.34 

.48 

.03 

.940 

1.74 

.34 

.35 

.49 

.05 

.945 

1.70 

.35 

.37 

.70 

.07 

.950 

1.03 

.34 

.30 

.71 

.09 

.955 

1.09 

.37 

.39 

.72 

.91 

.940 

1.90 

.30 

.40 

.73 

.93 

.945 

2.01 

.39 

.41 

.74 

.95 

.970 

2.09 

.40 

.42 

.75 

.97 

.975 

2.10 

.41 

.44 

.74 

1.00 

.900 

2.30 

.42 

.45 

.77 

1.02 

.905 

2.44 

.43 

.44 

.78 

1.05 

.990 

2.45 

.44 

.47 

.79 

1.07 

.990 

2.99 

.45 

.48 

.00 

1.10 

.44 

.50 

.81 

1.13 

.47 

.51 

.82 

1.14 

.40 

.52 

.83 

1.19 

.49 

.54 

.84 

1.22 

.50 

.95 

.85 

1.24 

.51 

.54 

a 

1.29 

.52 

.50 

.87 

1.33 

.53 

.59 

o  SMP 

1.30 

.54 

.40 

.09 

1.42 

.95 

.42 

.54 

.43 

.57 

.45 

.50 

.44 

.59 

.48 

undar  .25 

oay  ba 

takan  as 

aqul  val  ant 

to  sva. 

i  tabla  is 

takan 

froo  F i  shar ,  R.  A. , 

"Statistical  Nat hods 

Vaaaarch  Workars",  (Vth  ad.p  London t  Olivar  and  Boyd,  1V41>. 


«m53SIIJ8sl2mm83 


Iwlrtituttm  in  Mm  foriula  for  ■  i 

-  I 


•  .2774 

Hm  Ml  cMfifMC*  intsrvsl  for  ths  trio  s  is  cooputsd  using  ths 
foroMla  li  (V  >1»  whsrs  s  is  Mm  z-ocors  for  Mw  .96  lsvsl  of 
confirfoic*.  Ths  confitfMC*  interval  for  Mm  tries  s  is  0.2664  to 
1.9791  Ci.s.,  .69KI.96x.2774  or  .63*.  9436). 

Convartinf  thorns  «vs  hock  into  r*s  yislOs  o  coofiOsocs  intsrvsl 
from  .27  to  .66. 

Intorprst  ths  statistic. 

THs  96X  confiOswcs  intsrvsl  for  r  sxtsnds  froo  ths  .27  to  .66. 
Thus,  thsrs  is  a  96X  likslihood  that  this  intsrvsl  includsm  ths 
trus  r.  lines  ths  intsrvsl  1  we  1  udss  wily  positivs  valuss  and 
sxcludss  isro,  ths  corrslation  is  considsrsd  to  bs  statistically 
signl ficawt. 


b  -  ru<sy/S> 

-  .66090.0396/20) 

-  . 6609 < . 2918) 

-  .1714 


-  66. 3790- (. 1714) (106) 

-  66.3790-16.1730 


66.2020 


Select  tiM  cut  point 


a.  Selecting  the  cut  ecore  ie  Speed  on  the  eetehl iehed  ASM! 
•ten <erd  (selector  ores  aptitude  score)  for  entry  into  the  HOB. 
Suppose  that  the  selector  AA  score  for  entry  into  the  tested  IDS 
is  SI  100.  Substituting  values  in  Mae  fol losing  for aula  yields! 

y*  e+bx  -  68.2020+  .1714k 

•  IS. 2020+  .1714(100) 

*  SB. 3  (predicted  cut  score) 

b.  When  selecting  the  cut  score,  analysts  should  exasine  the 
inpact  of  various  levels  of  predicted  cut  scores. 

(1)  Construct  a  frequency  chart  uith  values  of  the  per  for nance 
erasure.  Each  cell  gives  the  frequency  of  data  falling  at  the 
perfornance  oeasure  ranges. 

frequency  Chart 

Per  for  nance  I-IIIA  HIS  Overall 

Scores 


score*  SB 


(2)  Convert  to  conditional  protoatoi 1 ities 


It  can  be  seen  froo  the  above  table  that  if  the  cut  score  is  set 
at  85,  an  individual  in  AFOT  Categories  I-IIIA  can  be  expected  to 
have  an  84X  (31/37)  chance  of  being  successful!  a  IIIS  can  be 
expected  to  have  a  73X  (21/28)  chance  of  being  successful.  A 
conpleted  probability  table  is  shown  below. 


Cut  Score 

I-IIIA 

HIS 

Total 

SB 

1.00 

1.00 

1.00 

70 

.97 

1.00 

.90 

75 

.96 

1.00 

.97 

SO 

.92 

.93 

.92 

85 

.04 

.75 

.80 

SO 

.73 

.36 

.57 

95 

.51 

.21 

.36 
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IX  F 


TEST  I  MB  THE  STATISTICAL  8ISMIFICAMCE  OF  THE  DIFFERENCE  BETWEEN 

TWO  MEANS 


rrtvlt* 


TMtinf  is  the  part  of  the  scientific  aathod  that  provides  the 
Basis  for  accepting  or  rejecting  a  hypothesis.  The  test  criteria 
allow  fornul at  ion  of  a  hypothesis  (soldiers  with  higher  AFQT 
scores  per  fora  Better  than  those  with  lower  scores).  The 
following  steps  explain  how  to  deteraine  if  the  difference 
Bet we an  the  groups  is  statistically  significant.  The  for aula  for 
calculating  the  t-statistic  isi 

t  ■  a-B 


where  a  and  b  represent  the  aean  scores  of  the  two  groups  on  the 
per foraance  aeasure  and  sd  is  the  standard  deviation. 


<1122.8544+1665.3336) (.08) 
48 

/  (58.0673) ( . 06) 

44.  647  «  2.1557 


2.3/2.1557 


1.0669  (obtained  t-value) 


l mcimrur- 


Find  in  column  1  the  value  calculated  for  na+nb-2. 

Find  the  t-value  which  corresponds  to  column  1. 

Tabled  t -Values 
<p  -  .05) 


Column  1 

Column  2 

Column  1 

Column  2 

6 

2.45 

21 

2.08 

7 

2.36 

22 

2.07 

8 

2.31 

23 

2.07 

9 

2.26 

24 

2.06 

10 

2.23 

25 

2.06 

11 

2.20 

26 

2.06 

12 

2.18 

27 

2.05 

13 

2.16 

28 

2.05 

14 

2.14 

29 

2.04 

15 

2. 13 

30 

2.04 

16 

2. 12 

40 

2.02 

17 

2.11 

60 

2.00 

18 

2.10 

120 

1.98 

19 

2.09 

1.96 

20 

2.09 

(This  table  is  taken  from  Table  III  of  Fisher  and  Yates* 
"Statistical  Tables  for  Biological,  Agricultural ,  and  Medical 
Research,"  published  by  Longman  Group,  Ltd). 

c.  t*  2.02  (tabled  t-statistic) 


The  obtained  t -value  (step  4)  say  have  been  negative.  Ignore  the 
negative  sign  if  there  is  one,  and  cospare  the  absolute  size  of 
the  obtained  value.  If  the  obtained  value  is  larger  than  the 
tabled  value  (step  5)v  the  difference  between  the  two  groups  was 
statistically  significant. 

If  the  obtained  t-value  was  not  larger  than  the  tabled  t-value, 
the  difference  could  have  been  the  result  of  chance.  Since  the 
result  cannot  be  regarded  as  showing  that  either  group  did  better 
than  the  other ,  the  difference  between  the  two  groups  was  not 
statistically  significant. 

Step  7i _ Calculate  the  95X  confidence  lisits. 

a.  Figure  the  lower  lisit. 

LL  «  d-(tXsd) 

where  d  is  the  value  calculated  in  step  2|  sd  calculated  in  step 
3f  and  the  tabled  t— value  fros  step  5.  Substituting  the  values 
from  the  previous  steps  yieldi 

LL  «  2.3— (2. 02) (2. 1557) 

«  -2.0545 

b.  Figure  the  upper  limit. 

UL  »  d+(t > (sd) 

/ 

«  2. 3+(2.02> (2. 1557) 

*  £.6545 

8*tp  fli _ Inttrpr?*  th? 

Does  the  confidence  interval  (that  is,  the  range  of  values  from 
the  lower  to  the  upper  limit)  include  zero?  If  YES,  the  obtained 
difference  between  the  groups  could  have  been  due  to  chance.  The 
difference  between  the  groups  is  not  statistically  significant. 

If  NO  and  both  limits  are  either  positive  or  negative,  the 
difference  between  means  is  likely  to  occur  again  in  favor  of  the 
same  group  if  the  program  were  repeated.  The  obtained  difference 
is  statistically  significant.  In  other  words,  it  is  extremely 
unlikely  that  this  difference  occurred  by  chance. 


The  AFQT  group  I-IIIA  NCO’s  generally  achieved  higher  scores  than 
the  AFQT  group  1 1  IB  NCO’s.  The  obtained  difference  was  not 
statistically  significant.  However,  this  could  have  been 


obtained  by  chance  (since  the  raiifi  of  values  incl< 
There  is  a  high  probability  (sore  than  99X)  that  the 
of  2.3  points  for  the  I-111A  NCO’s  could  have  rm 
chance  variation  between  the  groups. 


tea  >ero>. 
difference 
sited  free 


0 


APPENDIX  6 


ESTABLISHING  DO  REQUIREMENTS 


Defining  Mwpowr  quality  in  measurable  t*rM  is  critical  to  the 
Army's  ability  to  estimate  accession  requireaents.  Estiaating 
entry  level  quality  needs  in  teras  of  skill  level  1  or  2  is  not 
sufficient  because  the  Army  must  develop  its  supervisors  from  its 
pool  of  recruits.  A  sufficient  number  of  individuals  must  be 
accessed,  trained,  and  retained  from  the  recruit  pool  to  fill 
future  NOD  needs. 

This  appendix  contains  a  step-by-step  explanation  for  translating 
the  performance  criteria  for  a  given  skill  level  to  an  area 
aptitude  distribution  and  then  to  an  AFQT  distribution  that  would 
be  required  at  lower  skill  levels. 

A  very  basic  assumption  underlying  this  approach  is  that  the 
sample  of  soldiers  administered  the  performance  measure  is 
representati ve  of  the  population.  A  representative  sample  is 
defined  as  one  in  which  the  distribution  of  ASVAB  scores  closely 
parallels  that  of  the  population. 

Additionally,  a  sufficient  number  of  soldiers  must  be  tested  to 
permit  stat ist ical ly  valid  findings.  In  other  words,  a  sample  is 
tested  and  the  results  are  projected  to  the  population. 


Step  li  Construct  a  frequency  table. 

Using  the  selector  area  aptitude  scores  obtained  from  the  sample, 
construct  a  frequency  table  with  values  of  the  selector  area 
aptitude.  Each  cell  of  the  frequency  table  gives  the  number  of 
data  cases  falling  at  each  area  aptitude  ranges. 

Selector  area  aptitude  composite  C8I1) 


90-94 

95-99 

100-104 

105-109 

110-114 

115-119 

120-12 

9 

8 

13 

17 

9 

7 

2 

2i  Convert  the  AA  distribution  into  an  AFQT  distribution. 

Convert  the  AA  distribution  into  an  AFQT  distribution  using  the 
attached  conversion  tables,  one  for  each  AA  composite. 


To  use  the  tables,  multiply  the  sample  size  of  each  AA  score 
range  by  the  percentages  in  the  appropriate  column  for  the  AA 


score  rang*.  This  process  results  in  the  expected  AFQT 
distribution  for  the  individuals  in  the  sample. 


For  example,  using  the  AA  distribution  identified  above  and  the 
AA  to  AFQT  distribution  table  for  the  GH  composite,  the  following 
AFQT  distribution  is  obtained! 


90- 

95- 

ioo- 

105- 

HO- 

115- 

120- 

94 

99 

104 

109 

114 

119 

124 

X 

Expected  AFQT l 
distribution  !  9 

8 

13 

17 

9 

7 

2 

I 

I 


I-IIIA 

3 

4 

8 

12 

7 

6 

2 

65 

I IIB 

3 

2 

4 

4 

2 

1 

0 

25 

IV 

3 

2 

1 

1 

0 

0 

0 

io 

Notes: 

1.  The 

number . 

numbers  have 

been 

rounded 

off  to 

the 

nearest 

whole 

2.  If  9  individuals  scored  between  90—94  on  the  GM  composite, 
2.81  individuals  (9x.3125)  were  projected  to  be  in  AFQT  category 
I-1IIA,  3.47  C9X.385S)  to  be  in  AFQT  category  1 1  IB,  and  2.72 

(9X.3019)  in  AFQT  category  IV. 

Step  3s _ Determine  the  accession  quality  mix. 

Translate  the  obtained  AFQT  distribution  (step  2)  into  the  AFQT 
distribution  that  would  be  required  for  accession. 

a.  Based  on  the  performance  data,  the  following  skill  level  3 
AFQT  distribution  was  obtained: 

Per  cent  by  AFQT  category* 

I— I I I A  I I IB  IV 

65  25  10 


*desired  quality  mix 

b.  To  translate  these  numbers  into  the  accession  vector  required 
to  yield  the  desired  quality  mix,  divide  each  percentage  by  the 
historical  continuation/survi val  rates. 


I-IIIA  65/. 0645-  993 „ 88 
I I IB  25/. 0696-  359.20 
IV  10/. 0837-  119.47 


c.  To  determine  the  accession  proportions,  sum  the  nunbers  and 
then  divide  each  nunber  by  the  sun. 

993.88/1472.55-  .67** 

359.20/1472.55-  .24** 

119.47/1472.55-  .09** 

**desired  accession  quality  nix 


CONVERSION  TABLES  FOR  ESTIMATING  AFQT  PERCENTILE  DISTRIBUTIONS 
FROM  AREA  APTITUDE  STANDARD  SCORE  DISTRIBUTIONS! 


Clerical  CCL)  Aptitude  Area  Composite 
AA  Standard  Score 


AFQT 

BO- 

85- 

go- 

95- 

100- 

Xile 

84 

90 

94 

99 

104 

I-IIIA 

.00 

.  10 

6.11 

27.64 

62.78 

1 1  IB 

7.47 

38.95 

76.19 

67.37 

36.80 

IV 

92.53 

60.94 

17.70 

5.00 

.41 

Clerical  (CL)  Aptitude  Area  Composite 
AA  Standard  Score 


AFQT 

105- 

no¬ 

115- 

120- 

125- 

130> 

Xile 

109 

us 

120 

124 

129 

I-IIIA 

88.23 

97.26 

98.83 

100.00 

100.00 

100.00 

1 1  IB 

11.77 

2.73 

1.17 

O 

o 

■ 

.00 

.00 

IV 

.00 

.00 

.00 

.oo 

.OO 

.00 

Army  Combat  (CO)  Aptitude  Area  Composite 

AA  Standard  Score 

AFQT 

BO- 

85- 

BO- 

95- 

100- 

Xile 

84 

89 

94 

99 

104 

I-IIIA 

2.31 

12.63 

24.29 

43.49 

62.48 

I IIB 

30.02 

38.02 

44.11 

38.87 

25.31 

IV 

67.67 

49.36 

31.58 

17.63 

12.20 

40 


Army  Combat  (CO)  Aptitude  Art*  Composite 
AA  Standard  Score 


AFQT 

105- 

HO- 

115- 

120- 

125- 

130> 

Xile 

109 

115 

120 

124 

129 

I-IIIA 

72.89 

82.08 

87.50 

95.56 

99.03 

100.00 

1 1  IB 

21.16 

14.57 

11.76 

4.44 

.97 

.00 

IV 

5.96 

3.36 

.74 

.00 

.00 

.00 

Electronics  (EL)  Aptitude  Ares  Composite 
AA  Standard  Score 


AFQT 

80- 

85- 

90- 

95- 

lOO- 

Xile 

84 

89 

94 

99 

104 

I-IIIA 

1.52 

6. 12 

21.89 

45.42 

58.68 

1 1  IB 

25.55 

45.80 

48.10 

42.36 

36.49 

IV 

72.93 

48.09 

30.01 

12.22 

4.84 

Electronics  (EL)  Aptitude  Area  Composite 

AA  Standard  Score 

AFQT 

105- 

110- 

115- 

120- 

125- 

130> 

Xile 

109 

llS 

120 

124 

129 

I-IIIA 

77.84 

92.46 

96.13 

98.72 

99.95 

100.00 

1 1  IB 

19.75 

7.26 

3.87 

1.27 

.06 

.OO 

IV 

2.40 

.28 

.00 

.00 

.00 

.OO 

Field  Artillery  (FA)  Aptitude 

Area  Composite 

AA  Standard  Score 

AFQT 

80- 

85- 

90- 

95- 

100- 

Xile 

84 

89 

94 

99 

104 

I-IIIA 

1.22 

6. 13 

20.75 

38.76 

60.50 

IIIB 

27.76 

38.01 

50.54 

48.49 

36.44 

IV 

71.03 

55.84 

28.70 

12.75 

3.06 

41 


Fiald  Artillery  CFA)  Aptituda  Araa  Coapoaita 
AA  Standard  Scot* 


AFQT 

105- 

no¬ 

115- 

120- 

125- 

130> 

Xila 

109 

us 

120 

124 

129 

I-IIIA 

80.88 

90.01 

97.55 

100.00 

100.00 

100.00 

11IB 

17.62 

9.59 

2.45 

.00 

.00 

.00 

IV 

1.50 

.41 

.00 

.00 

.00 

.00 

Sanar al 

Haintananca 

C8H)  Aptituda  Araa 

Coapoaita 

AA  Standard  Sc or a 

AFQT 

BO- 

85- 

90- 

95- 

100- 

Xila 

84 

B9 

94 

99 

104 

I-IIIA 

6.53 

18.09 

31.25 

50.94 

58.78 

I IIB 

32.29 

39.57 

38.55 

27.69 

28.66 

IV 

61.16 

42.34 

30.19 

21.38 

12.56 

Sanar al 

Haintananca 

<8M)  Aptituda  Araa 

Coapoaita 

AA  Standard  Scora 

AFQT 

105- 

lio¬ 

115- 

120- 

125- 

130> 

Xila 

109 

ns 

120 

124 

129 

I-IIIA 

67.88 

78.09 

87.73 

93.01 

95.96 

99.13 

IIIB 

23.00 

17.34 

11.25 

5.68 

4.04 

.86 

IV 

9.14 

4.56 

1.01 

1.32 

.00 

.00 

Hachanical  Haintananca  (Itl) 

Aptituda  Araa  Coapoaita 

AA  Standard  Scora 

AFQT 

BO- 

85- 

90- 

95- 

lOO- 

Xila 

84 

89 

94 

99 

104 

I-IIIA 

7.90 

15.05 

31.40 

52.79 

63.23 

IIIB 

25.19 

42.17 

39.80 

28.09 

23.21 

IV 

66.92 

42.76 

28.81 

19.11 

13.54 

Mechanical  Maintananct  (MM)  Apt  I  tude  Area  Caapoai  te 
AA  Standard  Scot* 


AFOT 

105- 

HO- 

115- 

120- 

125- 

130> 

XI  la 

109 

115 

120 

124 

129 

I-II1A 

69.25 

75.  35 

79.06 

89.32 

94.11 

98.  58 

Ill* 

21.09 

17.70 

IS.  76 

8.62 

4. 84 

1.42 

IV  9.67 

Oparatora/Food  (OF) 

AA  Standard  8c or a 

6.96  2.19 

Aptitude  Area  Coap 

2.07 

oaite 

1.05 

.00 

AFOT 

BO- 

85- 

90- 

95- 

100- 

Xi  la 

84 

89 

94 

99 

104 

I-111A 

.18 

2.85 

15.47 

34.53 

59.44 

1 1  IB 

11.44 

36.11 

50.01 

44.04 

32.14 

IV  08.38 

Operator s/ Food  (OF) 

AA  Standard  Score 

61.07  34.51  21.43 

Aptitude  Area  Coaposite 

8.42 

AFOT 

105- 

110- 

115- 

120- 

125- 

130> 

Xi  la 

109 

llS 

120 

124 

129 

I-IIIA 

73.58 

80.71 

89.95 

96.08 

99.87 

100.00 

I IIB 

22.65 

16.35 

9.41 

3.92 

.  14 

.OO 

IV 

3.76 

2.93 

.63 

.00 

.OO 

.OO 

Sur  vai  1 1  anc  e/Coaaun  I  c  at  i  on» 

AA  Standard  Score 

(SC)  Aptitude  Area  Coapoaite 

AFOT 

BO- 

85- 

90- 

95- 

ioo- 

Xila 

84 

89 

94 

99 

104 

I-IIIA 

1.16 

6.41 

22.55 

45.72 

66.18 

1 1  IB 

29.73 

45.79 

50.12 

38.36 

22.69 

IV 

69.11 

47.81 

27.35 

15.91 

11.11 
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Survai  1  lane •/CowMuni cations  (1C)  Aptitud*  Atm  Coapotit* 


AA  Standard  Scot* 


ATOT 

105- 

no¬ 

115- 

120- 

125- 

130> 

Xila 

109 

us 

120 

124 

129 

I-IIIA 

71. OS 

77.77 

S7.82 

95.32 

99.99 

99.91 

1IIS 

20.  S3 

19.87 

12.  12 

4.68 

.00 

.00 

IV 

8.09 

2.  as 

.06 

.00 

.00 

.oo 

Skilled  Technical  <8T>  Apt  it  tad*  Araa  Coopoait# 
AA  Standard  Scot* 


ATOT 

80- 

85- 

90- 

95- 

10O- 

Xila 

84 

89 

94 

99 

104 

I-IIIA 

1.05 

4.52 

18.34 

36.01 

60.26 

1IIB 

22.16 

35.67 

51.59 

48.33 

34.30 

IV 

76.80 

59.81 

30.07 

15.66 

5.45 

Skillad 

Tachnical 

<8T)  Aptituda 

Araa  Coa*»osit* 

AA  Standard  Scot* 


AFOT 

105- 

no¬ 

115- 

120- 

125- 

130> 

Xila 

109 

us 

120 

124 

129 

I-IIIA 

73.03 

87.56 

96.41 

98.39 

99.81 

99.33 

1 1  IB 

24.81 

11.24 

3.59 

1.61 

.  19 

.66 

IV 

2.17 

1.19 

.00 

.OO 

.00 

.00 

$ 
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IX  N 


•AMPLE  00  ANALYSIS  REPORT 


I-  Target  Skill  Ltwli  EEs  (skill  lml  3>  havt  the  required 
technical  expertise  and  ar*  usually  first  1  in*  supervisors  or 
section  chiefs. 


a.  Sasic  NCO  course  (BNCOC) 

(1)  Length!  12  weeks 

(2)  Coaaon  subjects!  Leadership*  training  sanagesent, 
nuclear,  chenical,  biological,  saintenance,  land  navigation, 
logistics,  personnel,  and  weapons. 

(3)  Narrative  description!  Basic  level  training  is 
functional  within  the  career  sanagesent  field  (CNF)  and  is 
oriented  toward  appropriate  quali fi cat ion  at  section  chief  skill 
level.  Esphasis  is  placed  on  leadership  and  husan  relations 
skills  and  knowledge  of  subjects  required  to  perfors  effectively 
at  the  section  chief  level.  Training  is  directed  toward 
providing  a  firs  coaprehension  of  NCO's  role  in  cosbat,  coabat 
support,  and  service  support. 

b.  Content  validity/reliability 

(l>  The  Content  Evaluation  Panel  consisted  of  40  job 
incuabents,  supervisors,  and  instructors.  Each  panel  aeaber  was 
supplied  with  a  copy  of  the  end-of-course  coaprehensi ve 
exaai nation  and  a  copy  of  the  critical  task  list  along  with  the 
required  knowledge,  skills,  and  abilities  associated  with  each 
critical  task.  The  "essentiality”  question  was  aodified  by 
changing  the  second  response  "useful  but  not  essential,”  to 
"useful  but  can  be  learned  on-the-job. "  Each  panelist  indicated 
his  response  on  the  answer  sheet  for  each  of  the  100  questions. 

(2)  Quantifying  the  results.  The  responses  were  pooled 
for  each  ites  and  the  content  validity  ratio  was  coaputed  for 
each  (These  CVR  values  are  tabulated  below) •  When  the  seen  of 
the  values  was  coaputed,  the  content  validity  index  for  the  total 
test  is  .33f  when  the  itess  that  failed  to  seet  statistical 
significance  are  elisinated  the  CVI  is  .74. 
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Distribution  of  CVR  Values 


ne 

CVR 

cuMulati ve 

40 

1.00 

15 

15.00 

15.00 

37 

a  Ow 

14 

11.90 

28.90 

34 

.70 

13 

9.10 

38.00 

32 

.80 

12 

7.20 

43.20 

29 

.45 

11 

4.95 

48.15 

25 

.25 

108 

2.50 

50.85 

24 

.20 

98 

1.80 

52.45 

21 

.05 

88 

.40 

52.85 

20 

.00 

78 

.OO 

52.85 

CVI-  52.85/100-  .5285 


*  Fiil*d  to  soot  statistical  significance — a  Minima*  CVR  of  .29 
is  roquirad  to  satisfy  tha  .05  laval  of  signi f icanca. 

(3)  Kuder -Richard son  reliability  coefficients 


(100/99) 


49.3931 


-  .8248  (strong  positive  correlation) 

Test  for  signi f icanca 

When  M— 65  and  df  is  63,  an  r  Must  be  .250  to  be  significant  at 
the  .05  level  and  .325  to  be  significant  at  the  .01  level.  It  is 
clear  that  the  obtained  r  of  .8248  is  highly  significant  at  the 
.01  level y  since  it  is  higher  than  .325. 

c.  Mini mum  acceptable  score 

Correlation  coefficient  (AA  score  vs  E0C  exan) 


85 (61 8524 >-(6836x5872) _ 

^C65<  724230) -(6836)*  1 C65 (533678)  -  <58721 


.2354 


Standard  deviation  of  the  AA  scores 


-  9.0240 


Standard  deviation  of  tha  parforaanca  data 

•y-  /333678-(3B72> 


-  7.02S0 

Cor r act  tha  corralation  coafficlant  for  ranga  raatriction 

ru-  .2334(20/9.024) _ 

f  Cl-(.2354)*  )C (.2354/  C (20)^(9.024 fl) 

■  .4730  (stodarata  positiva  corralation) 


Taat  for  aignificanca 

SE  -  1 

/65— 3 

-  . 1270 

whan  r«.4730  and  N-63  tha  corraaponding  Z-.51.  Tha  confidanca 
intarval  at  tha  .05  laval  of  aignificanca  for  tha  trua  z  ia  now 
.31+  .2489  or  .2611  to  .7389.  Convarting  thaaa  z*a  back  into  r*a 
yialda  a  confidanca  intarval  frost  .25  to  .64. 

Tha  corralation  coafficiant  batwaan  tha  araa  aptituda  acoras  and 
tha  BNCOC  acoraa  ahowa  that  thara  ia  a  aodarata  poaitiva 
corralation.  Sinca  tha  confidanca  intarval  axtanda  frost  .23 
to  •  64,  tha  trua  corralation  ia  poaitiva,  waak  to  atrong  in 
stagnituda. 


Straight  lina  aquationi  ym  a+bx 

b«  .473C 7. 028/203 


.1662 


a-  ( 3872/63) -C. 1662( 


72.8393 


/63)  3 


y»  72.8393+  . 1662x 
-  72.8393+  .1662(100) 

■  89.5  (pradictad  cut  acora) 


Frtqutncy  Chart 


Par  foraanca 
8c  or  as 


I-IIIA 


1 1 18 


Ovarall 


70-74 

75-79 


t 

1 

1 

3 


0 

0 

2 

S 


1 

1 

3 


pradictad  cut  sc or a 


85-89 

4 

11 

15 

90-94 

8 

4 

12 

95-99 

19 

6 

25 

Total 

37 

28 

65 

Conditional  Probabi 1 itias 

I-IIIA 

1 1  IB 

Ovaral ) 

65 

1.00 

1.00 

1.00 

70 

.97 

1.00 

.98 

75 

.95 

1.00 

.97 

80 

.92 

.93 

.92 

85 

.84 

.75 

.80 

90 

.73 

.36 

.57 

95 

.51 

.21 

.38 

According  to  tha 

tab  la  abova 

,  if  tha 

CUt  SCOT 

I-IIIA  would  hava  a  73X  chanca  of  baing  succassful,  and  a  1 1  IB 
would  Hava  a  36X  chanca  of  baing  succassful. 


UI« _ Rtffrth  Ptiian 

a.  Data  collactiont 

Cl)  Tha  H08  to  ba  studiad  wara  placad  into  groups  (09B, 
09C ,  09D)  and  <09EV  09Ff  096).  Data  froa  tha  BNCOC 

and— of-c  our  sa  axaa  wara  col  lac  tad  froa  1  Nay-31  Aug  on  ona  NOS 
from  aach  group. 

(2)  Basic  to  achiaving  tha  study  goal,  tha  gatharad  data 
wara  usad  to  dataraina  if  a  statistical  ralationship  axistad 
batwaan  soldiar  parforaanca  and  quality  as  aaasurad  by  tha  A8VAB. 
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b.  Analysis* 


Cl)  Alter native  hypothesis*  Soldiers  with  higher  AFQT 
scores  <1-1 I IA)  perform  better  than  soldiers  with  lower  AFQT 
scores  CHIB). 


<2)  Null  hypothesis*  Soldiers  with  higher  AFQT  scores  do 
not  perform  better  than  soldiers  with  lower  AFQT  scores. 

(3)  Descriptive  data  table 


Sroup 

a 

b 


AFQT  category  He«n  score  Std  dev  Sample  size  (n) 


I-IIIA 
1 1  IB 


91.84 

88.36 


7.6742 

3.4721 


37 

28 


(4)  Significance  level*  .05 

<5)  Rules  Reject  the  null  hypothesis  if  the  obtained 
t-statistic  is  greater  than  the  tabled  t-statistic. 

(6)  The  formula  for  determining  the  t-statistic  is: 


t  *  a-b 
sd 


substituting  previously  computed  values  in  the  formula  yields 

-  _ 91.84-8B.36 _ 

A (7.6742)  (37— 1)+<5.4721)  (28-1)311/37  +  1/283 
/  <37+28-2) 

*  2.9098 

(7)  tabled  t— statistics  2.00 

(8)  Since  the  obtained  t— statistic  (2.9098)  is  greater 
than  the  tabled  t-statistic,  the  null  hypothesis  was  rejected. 
The  conclusion  was  that  soldiers  with  higher  AFQT  scores  perform 
better  than  those  with  1 ower  AFQT  scores. 

(9)  95%  confidence  limits 

Lower  limit-  3. 48- (2. 00x1. 196) 

-  1.088 

Upper  limit-  3. 48+ (2. 00x1. 196) 

-  5.8720 

Since  both  limits  are  positive,  there  is  a  95%  probability  that 
the  difference  between  the  two  AFQT  categories  is  statistically 
significant.  In  other  words,  it  is  extremely  unlikely  that  this 
difference  occurred  by  chance. 


c.  Descriptive  data  summary 


Number 

Tested 

Mean  BNCOC 
Score 

Std  Dev 

Mean  AA 
Score 

Std  Dev 

I-XIIA  37 

91.64 

7.6742 

109.05 

7.7388 

IIIB  28 

88.36 

5.4721 

103.74 

7.9753 

Overal 1  65 

90.34 

7.0280 

105. 17 

9.0240 

d.  Desired  quality  accession  mix 
Step  1.  Construct  an  AA  frequency  distribution  table. 

Selector  area  aptitude  coaposite  COM) 

90-94  95-99  100-104  105-109  110-114  115-119  120-124 


9  8  13 


17 


9 


7  2 


Step  2.  Convert  AA  score  to  an  AFQT  distribution. 


I 


90- 

94 

95- 

99 

100- 

104 

105- 

109 

HO- 

114 

115- 

119 

120- 

124 

X 

Expected  AFQT! 
distribution  ! 

9 

8 

13 

17 

9 

7 

2 

l 

I 


I-IIIA 

3 

4 

8 

12 

7 

6 

2 

65 

IIIB 

3 

2 

4 

4 

2 

1 

0 

25 

IV 

3 

2 

1 

1 

0 

O 

0 

10 

Per  cent  by  AFQT  category* 

I— I I I A  I I IB  IV 

65  25  10 

*desired  quality  mix 

Step  3.  Translate  desired  quality  mix  at  the  Target  Skill  Level 
into  desired  accession  vector. 

I— I I I A  65/. 0645*  993.88 
I I IB  25/. 0696-  359.20 
IV  10/. 0837-  119.47 


993.88/1472.55-  .67* 
359.20/1472.55-  .24* 
119.47/1472.55-  .09* 


*desired  accession  quality  mix 


IV.  na-»or  Finding* 

a.  The  data  generally  supported  the  hypothesis  that  skill 
level  3  soldiers  with  higher  AFQT  scores  perforn  better  than 
soldiers  with  lower  AFQT  scores.  There  is  a  high  probability 
(93%)  that  the  I-IIIA  AFQT  category  soldiers  would  cose  out  ahead 
again  if  the  study  were  repeated. 

b.  The  sasple  correlation  coefficient  provided  us  a  point 
estimate  of  the  strength  of  the  linear  relationship  between  the 
perfornance  Measure  scores  and  the  quality  data  (ASVAB  scores). 
The  coefficient  shows  a  positive  correlation  that  is  Moderate  in 
Magnitude.  We  can  reasonably  conclude  that  as  AA  scores 
increase,  perfornance  on  the  test  instrusent  increases.  Since  AA 
scores  are  highly  correlated  to  AFQT  scores,  soldiers  in  AFQT 
Categories  I-IXIA  will  probably  per  fore  significantly  better  than 
Category  II IB  soldiers. 

c.  Based  on  the  validated  perfornance  Measure  analysis,  the 
level  of  quality  as  Measured  by  the  ASVAB  needed  to  be  accessed 
is: 


I-IIIA:  £7% 


I I IB:  24X 


IV:  9X 


^ Ji -i , : - 

.1  .<  .■  • 

• 

Collected 

date 

I-IIIA 

1 1  IB 

d 

AFQT 

BNCOC 

AA 

AFQT 

BNCOC 

AA 

Xile 

Scores 

Scores 

Xile 

Scores 

Scores 

60 

91 

106 

38 

89 

102 

% 

84 

94 

120 

38 

81 

106 

75 

88 

108 

41 

94 

82 

53 

95 

98 

31 

94 

89 

< ' 

67 

66 

107 

34 

83 

99 

60 

74 

107 

42 

87 

102 

65 

81 

104 

40 

86 

96 

53 

98 

101 

44 

79 

92 

' 

62 

96 

108 

41 

82 

93 

70 

99 

112 

41 

92 

103 

,  <• 

56 

99 

114 

41 

88 

89 

« 

58 

97 

105 

31 

85 

101 

* 

50 

96 

107 

31 

84 

96 

50 

93 

103 

42 

97 

109 

86 

95 

119 

30 

96 

96 

62 

98 

112 

45 

96 

94 

f  * 

50 

87 

109 

38 

95 

89 

59 

89 

116 

41 

97 

104 

63 

89 

91 

84 

115 

84 

41 

34 

96 

79 

98 

97 

<!> 

53 

77 

109 

43 

85 

108 

58 

84 

102 

30 

86 

113 

4( 

89 

91 

118 

45 

87 

lOl 

53 

85 

92 

46 

84 

119 

77 

93 

114 

35 

85 

106 

67 

90 

108 

38 

88 

104 

1**1 

77 

90 

115 

44 

91 

106 

# 

55 

95 

114 

35 

88 

107 

?;* 

if 

52 

99 

111 

50 

99 

114 

*> 

58 

96 

99 

89 

98 

119 

»»* 

77 

96 

113 

84 

99 

112 

•vt 

86 

98 

123 

i 

6 

86 

98 

108 

‘4  ' 

(t 

1 

v» 

% 

80 

99 

109 

’■'  .■ 

* 

;r' 

i'O 

*•> 

«r 

52 
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